An Optimal First Order Method Based on Optimal Quadratic Averaging
نویسندگان
چکیده
منابع مشابه
An optimal first order method based on optimal quadratic averaging
In a recent paper, Bubeck, Lee, and Singh introduced a new first order method for minimizing smooth strongly convex functions. Their geometric descent algorithm, largely inspired by the ellipsoid method, enjoys the optimal linear rate of convergence. We show that the same iterate sequence is generated by a scheme that in each iteration computes an optimal average of quadratic lower-models of th...
متن کاملOptimal control of quantum systems: An approximation based on averaging
We consider the optimal control problem for a (finite-dimensional) quantum system with an energy-like cost. We explore the limit of small control amplitude and construct an approximation to the two-point boundary value problem resulting from the Maximum Principle. By solving the approximate two-point boundary value problem in two examples, we argue that this limit corresponds to the limit of la...
متن کاملAn optimal analytical method for nonlinear boundary value problems based on method of variation of parameter
In this paper, the authors present a modified convergent analytic algorithm for the solution of nonlinear boundary value problems by means of a variable parameter method and briefly, the method is called optimal variable parameter method. This method, based on the embedding of a parameter and an auxiliary operator, provides a computational advantage for the convergence of the approximate soluti...
متن کاملAn acceleration procedure for optimal first-order methods
We introduce in this paper an optimal first-order method that allows an easy and cheap evaluation of the local Lipschitz constant of the objective’s gradient. This constant must ideally be chosen at every iteration as small as possible, while serving in an indispensable upper bound for the value of the objective function. In the previously existing variants of optimal first-order methods, this ...
متن کاملOn Optimal Weighting Scheme in Model Averaging
Abstract Model averaging is an alternative to model selection and involves assigning weights to different models. A natural question that arises is whether there is an optimal weighting scheme. Various authors have shown their existence in others methodological frameworks. This paper investigates the derivation of optimal weights for model averaging using square error loss. It is shown that tho...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: SIAM Journal on Optimization
سال: 2018
ISSN: 1052-6234,1095-7189
DOI: 10.1137/16m1072528